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SPECIFICATION 
NETWORK CONTROL SYSTEM, AND DEVICE AND 
CONTROLLER USED IN NETWORK CONTROL SYSTEM 

5 FIELD OF THE INVENTION 

The present invention relates to a network control system for con- 
trolling equipment connected to a network to operate through the network 
and particularly relates to an equipment control system utihzing a graphical 
user interface (GUI) in assisting the user to operate the equipment by means 

10 • of graphics (icons), letters and the like that appear on a display screen. 

BACKROUND OF THE INVENTION 
In recent years, an equipment control system, whereby graphics 
(icons) formed of image display data, letters and the Uke to indicate the func- 
15 tion of equipment connected to a network are displayed on a television screen 
and the graphics on the screen are operated by selection through a remote 
controller to control the eqviipment, has been coming along on the market. 
Also coming along on the market is a network system, whereby video/audio 
data are transmitted/received with such digital equipment as DVC (Digital 
20 Video Cassette), TV and the hke hooked up through the use of IEEE 1394- 
1995, which is a digital interface. 

There is a conventional network control system as disclosed in-the 
Japanese Unexamined Patent PubUcation, TOKKAIHEI 9 -149325, for exam- 
ple. 

25 A network control system according to the above TOKKAIHEI 9 - 

149325 is described below as a typical conventional network control system. 

A variety of AV eqviipment (such as a device, controller and the like) 
are connected with a variety of other AV equipment without rel5dng on a 
switching operation between the variety of AV equipment through a serial bus 

30 where equal communication opportimities are provided periodically by a two- 
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way packet commxinication mode as in a digital interface according to such 
standards as IEEE1394 and the hke. 

Here, each respective AV equipment (device) has its own image dis- 
play data stored in itself while a controller being also one of the AV equipment 
5 and having a graphic display function and transmits the image display data 
according to a request from the controller (television receiver) and then the 
controller displays data for image display. 

Also, a controller has a function of inqviLring about data needed in 
displaying AV equipment (device) hooked up therewith via the afore- 
10 mentioned serial bus and also a function of controlling a display screen ac- 
cording to an image display data received from the AV eqviipment. 

A device, which is also one of AV equipment, has a recording medi- 
lun for storing image display data and a function of selecting an appropriate 
image display data against an inquiry about the image display from a con- 
15 troller. 

With the network control system thus configured, each respective 
device has image display data stored and outputted upon receiving a request 
for displaying from a controller (a television receiver, for example), thereby 
displaying its own graphics on the controUer*s display screen for controlling 

20 each respective device. 

However, with the configuration as described in the above, no in- 
formation on the device's control method is disclosed and, although a control- 
ler can display the information on a device, there has been a problem of diflS- 
culties in controlling the device. 

25 In addition, the image display data is intended for exclusive use of 

each respective AV equipment, resulting in a problem of lacking flexibility on 
the part of a controller at the time of image displaying. 

Furthermore, since AV equipment (device) selects an appropriate 
image display data against an inquiry from a controller relative to image dis- 

30 play data, a problem of imposing an excessive load on AV eqxiipment has been 
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created. 

DISCLOSURE OF THE INVENTION 
The present invention deals with the foregoing problems and dis- 
closes a network control system and a configuration thereof, whereby an op- 
erating environment siaitable for each respective function and equipment can 
be formed with a simple configuration, controlling of each respective equip- 
ment and function can be easily performed and also a new function, which can 
not be thought of at present, can be easily handled. 



BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a block diagram of a device in a network control system of 
the present invention. 

Fig. 2 is a block diagram of a controller in a network control system 
15 of the present invention. 
□ Fig. 3 shows a system configuration of a typical network control sys- 

?3 tem of the present invention. 

Fig. 4 is a diagram to describe an example of fixnction information in 
a first exemplary embodiment of the present invention. 
20 Fig. 5 is a diagram to describe a network control system in the first 

exemplary embodiment of the present invention. 

Fig. 6 is a diagram to describe an example of a transmission packet 
in the first exemplary embodiment of the present invention. 

Fig. 7 is a diagram to describe an example of function information 
25 when pseudo-moving images are used in the first exemplary embodiment of 
the present invention. 

Fig. 8 is a diagram to describe an example of function information 
when a host memory area is used in the first exemplary embodiment of the 
present invention. 

30 Fig. 9 is a diagram to describe a case, where a reference object is 
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used in function information, in a second exemplary of the present invention. 

Fig. 10 is a diagram to describe a case, where a plurality of reference 
objects are used in the function information, in the second exemplary of the 
present invention. 

5 Fig. 11 is a diagram to describe an example of configuring a sUder in 

the function information in the second exemplary embodiment. 

Fig. 12 is a diagram to describe an example of a user selection dis- 
play component in function information in a third exemplary embodiment of 
the present invention. 

10 Fig. 13 is a diagram to describe an example of a user definition dis- 

play component in function information in a fourth exemplary embodiment of 
the present invention. 

Fig. 14 is a diagram to describe an example of a plurahty of menus 
in function information in a fifth exemplary embodiment of the present inven- 

15 tion. 

Fig. 15 is a diagram to describe an example of a layered menu in the 
function information in the fifth exemplary embodiment of the present inven- 
tion. 

20 DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

Next, a description is given to a network control system in an exem- 
plary embodiment of the present invention with reference to drawings. — 

(First Exemplary Embodiment) 
Fig. 1 is a block diagram of a device in a network control system in a 
25 first exemplary embodiment of the present invention. Fig. 2 is a block dia- 
gram of a controller in the network control system in the first exemplary em- 
bodiment of the present invention. Next, a description is made on the con- 
figuration and operation of the network control system in the first exemplary 
embodiment of the present invention with reference to Fig. 1 and Fig. 2. 
30 In the present specification, the term "device" is used to mean an 
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object to be controlled and the term "controller" is used to mean what controlls 
the object to be controlled. In a unit of equipment, there may be both the 
device and controller or only any one of the device and controller. 

The equipment is what corresponds to a node of a transmission line 
5 and a unit is allowed to be configured by having a plurahty of nodes provided 
in a single housing. 

In Fig. 1, a transmission line 1 is a serial bus (1394 bus) as specified 
in accordance with the IEEE1394 Standards (IEEE 1394-1995 or a compati- 
ble higher level standard), for example. Further, the transmission line 1 is 
10 not necessarily reqvdred to be the 1394 bus but such other transmission lines 
as an ATM, Ethernet, infrared transmission line and the like can also be used. 

Also, a packet transmitting/receiving means 2 estabUshes a physical 
and electrical interface with the transmission line 1, reconciles the right to use 
a bus, performs cycle control for a synchronized transfer and does some other 
15 things. 

P Fvurther, the packet transmitting/receiving means 2 selectively re- 

c3 ceives packets on the tmasmission line 1 according to address and transmits , 

"~ packets to the transmission Une 1. 

A synchronous data transmitting/receiving means 3 manages 
20 a transfer rate (division of data) and adds a header when transmission is per- 
formed. For example, when an AV protocol standard for the 1394 bus 
(IEC61883) is used, the synchronous data transmitting/receiving means 3 
adds a CIP (Common Isochronous Packet) header. Conversely, when data 
reception is performed, the synchronization transmitting/receiving means 3 
25 arranges received packets in a correct sequence, eliminates headers and does 
some other things. 

A device signal processing means 4 receives synchronous data fi:om 
the synchronous data transmitting/receiving means 3 and performs signal 
processing corresponding to a device. For example, when the device is re- 
30 cording/reproducing eqidpment such as a digital VCR and the hke, a synchro- 
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nous data is recorded on a recording medium (a magnetic tape, for example). 
Also, the device signal processing means 4 takes out a synchronous data from 
a recording medium, broadcast signal and the like and transmits the synchro- 
nous data to the synchronous data transmitting/receiving means 3. 
5 An asynchronous data transmitting/receiving means 5 performs 

transaction processing of asynchronous data according to the protocol of the 
transmission line 1. For example, in the case of the 1394 bus, read transac- 
tion processing, write transaction processiag, lock transaction processing and 
the Uke are performed. The asynchronous data transmitting/receiving 
^£ 10 means 5 is also allowed to be configured with software. A device asjnichro- 
=G nous data processing means 6 processes asynchronous data received from the 

[j asjoichronous transmitting/receiving means 5 and transmits the processed 

asynchronous data to an appropriate composing element in the device. 
W For example, if an asynchronous data received by the device asyn- 

p 15 chronous data processing means 6 includes a control code and operation in- 
formation of the user, the vahdity thereof is examined and, when the exami- 
nation results in the affirmative, a directive is given to an equipment inter- 
£3 nals controlling means 9 for performing a function corresponding to this con- 

trol code and the user's control code. 
20 When equipment configuration information 7 is requested by a con- 

troller, the device asynchronous data processing means 6 sends out the infor- 
mation included in the eqviipment configuration information 7 in accordance 
with the requirement received via the asynchronous transmitting/receiving 
means 5 and the hke to the controller via the asynchronous data transmit- 
25 ting/receiving means 5 and the hke. 

Based on a directive fi'om the Qquipment internals controlling 
means 9, the device asynchronous data processing means 6 also sends out 
asynchronous data to the asynchronous data transmitting/receiving means 5 
fi:om composing elements in the device. 
30 Here, the as5Tichronous transmitting/receiving means 5 and device 
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asynchronous date processing means 6 are allowed to be built into a single 
means. 

The information relative to an equipment configuration accommo- 
dated in the eqvdpment configuration information 7 provides information on 
5 how eqmpment is configured. The foregoing information is described, for 
example, in accordance with the rxile indicated by a configuration ROM of 
CSR (Command and Status Registers) presented in the ISO/IEC13213:1994 
Standards and, when a 1394 bus is used, the foregoing information includes 
r J bus information, which the equipment deals with to see whether or not a bus 

jS 10 manager and isochronous performance are supported, a imit directory in- 
f ^ eluding information on whether or not an AV protocol is supported, a imique 

fy ID as an identification data of the eqvdpment and the like. In the foregoing 

equipment configuration information 7 is also included a leading address of 
;^ ROM15 to indicate the whereabouts of function information 8. 

I J 15 The function information 8 is a fisting of information that configures 

m an operation picture of the device. The function information 8 includes an 

object needed in operating the device, an identification data (ID) to identify 
the foregoing object and the like. 

Each respective object has a layered structure of a Hst format and 
20 each respective display component and information and even the Hst itself are 
all together referred to as an object in the present specification. 

Here, the display component refers to a still picture data of control 
buttons of the equipment and the like, a character data (text data) indicating 
functions and the Like, an audio data such as soimd effects and the Like, a pro- 
25 gram code including such display components as a stiU picture data, a charac- 
ter data (text data) and the Like, and more specifically refers to icons and the 
Like, for example. 

A display component data is what is obtained by having display 
components made a data and more specifically corresponds to a bit map data 
30 of pictxire and the like. 
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The information obtained from the function information 8 is trans- 
ferred according to the requirement of a controller on the transmission hne 1 
to the controller via the device asjrachronous data processing means 6, asyn- 
chronous data transmitting/receiving means 5 and the like. 
5 The function information 8 is placed in ROM15 and RAM16, and 

what is stored in the ROM15 is the information that is specific to the device, 
not requiring rewriting frequently and exemplified by an object such as a stiU 
picture and the like sjonboHcally showing control buttons of equipment. 

The ROM15 is also allowed to be formed of a flash ROM and the 
10 function of the equipment itself can be rewritten in this case. 

The controller on the transmission Hne 1 (not shown in Fig. 1) and 
the equipment internals controlling means 9 write an object in the RAM16, 
where the function information 8 is located, via a function information con- 
tents managing means 17 as it is required. The information written in here 
15 is contents information, status information and the like. 

What is referred to as the contents information here is the informa- 
tion on the programs that are being broadcast (program title, title picture, 
theme music, outhne, performers and the like) in the case where the device is 
an STB(Set Top Box), for example. In the case of a DVD, the contents infor- 
20 mation is the information on the contents (title, title picture, theme music, 
outline, performers and the like) recorded on a DVD disc. 

The status information as mentioned above is an object such -as a 
display component and the like including the status of equipment (plajdng, 
rewinding and recording being programmed) in the case of VCR, for example. 
25 In addition, the information needed in network controlling such as identifica- 
tion information and the like of the controller that is in use with the device, 
the date, time and channel number for programmed recording and the like is 
allowed be written in here. 

A function information contents managing means 17 is intended for 
30 performing a conversion between the identification data of an object and the 
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address of R0M15 or ROM16. 

Not only a conversion of the address is performed but also a new 
address is allocated when writing in the original address location can not be 
made because the data size has become excessively large after a certain dis- 
5 play component is converted in writing, for example. 

Accordingly, the controller on the transmission line 1 is allowed to 
read and write each respective object by means of the ID thereof by using the 
equipment internals controlling means 9 and device asynchronous data proc- 
essing means 6. 

10 On the other hand, when the controller knows the address of each 

respective object and the like, writing and reading can be performed by using 
the address of ROM15 or ROM16. 

Furthermore, the controller is allowed to read and write display 
components and the like by combining the above pieces of information and 

15 also allowed to read and write by means of a relative address in a display 
component as indicated by an ID. 

The function information contents managing means 17 controls 
object ID'S and assigns, for example, an ID, which does not dupHcate with the 
ones for other objects, to a newly added object and conversely invahdates an 

20 ID when an object assigned with the ID is erased. 

When a display component is changed, the function information 
contents managing means 17 can also be configured to have the information 
on the changed display component (an ID of an object or an ID and an object 
itseli^ transmitted to the controller, thereby making it imnecessary for the 

25 controller to watch aU the time an object that is likely to change and making it 
possible, for the controller to reduce a processing load. Accordingly, the con- 
troller can easily cope with the situations, in which an object shows cease- 
lessly changing status information and contents information. 

The eqviipment internals controlling means 9 controls each respec- 

30 tive composing element of the device including the internal mechanism and 
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the like thereof and, in case where the data received by the device asynchro- 
nous data processing means 6 is a control code and the like that indicate the 
operating status of the device, the equipment internals controlling means 9 
makes each respective composing element of the device operate according to 
5 the directive from the device asynchronous data processing means 6. 

The operational behavior of the device against the requirement and 
the like from the controller is as follows: 

When the device is hooked up with the transmission line 1 or the controller is 
hooked up with the transmission line 1, the controller reads eqmpment con- 

p 

10 figuration information from the equipment configuration information 7 of the 
^ device, confirms the whereabouts of the function information 8 and reads 

L J the function information 8. 

The equipment configuration information 7 is allowed to be config- 
ured in such a way as having no address information of the function informa- 
15 tion 8 and indicating only the existence of the function information 8 or to be 
configured to have no information ofthe function information 8. At this time, 
the controller issues a command of requesting the function information 8 to 
the device, thereby obtaining information ofthe function information 8. 

At this time, the controller is also allowed to be configured in such a 
20 way as obtaining part ofthe function information 8 such as a display compo- 
nent and the ID thereof only by issviing a command to obtain the foregoing 
display component. — 

When the device has obtained a control code (such as an ID of an 
object) and user*s operation information from the controller, the processing as 
25 indicated by the foregoing control code and user's operation information is 
performed according to the situations involved. 

However, when a control code of an object , for example, is transmit- 
ted together with user's operation information "selection" from the controller 
against an object of the display component indicating a device's certain func- 
30 tion, the asynchronous data ti-ansmitting/receiving means 5 issues a directive 
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requesting an execution of the function indicated by the object to the eqxiip- 
ment internals controlling means 9. 

Thus, what is required of the device is just an indication of the func- 
tion information 8 against the reqxiirement of GUI (Graphical User Interface) 

5 information from the controller, thereby allowing the load imposed on the 
device to be reduced. 

It is not necessary to specify the command according to a standardi- 
zation function and the like relative to each respective function of the device, 
and utilization of a new function via the transmission line 1 becomes possible 

10 readily against a device having the new function that can not be thought of at 
this moment. 

Such composing elements as the synchronous data transmit- 
ting/receiving means 3, device signal processing means 4 and the like is al- 
lowed to be configured by making a selection arbitrarily according to the func- 

15 tion of the device or to be eliminated entirely. 

Each respective means might be formed of any one selected from 
hardware and software. The function of the device is specified according to 
user's operation information and also according to a control code of an object in 
the present exemplary embodiment but it is also possible for the object's con- 

20 trol code to be configured in such a way as not approving anything other than 
"selection" as the user's operation, thereby enabhng the device to perform the 
function thereof according to a control code only with a resulting contribution 
to a reduction in size of the packet to be transmitted since the device's function 
can be specified only by a control code (an object ID, for example) against the 

25 object. 

An object ID is used as a control code in the present exemplary em- 
bodiment and on the other hand the control code is allowed to be set up arbi- 
trarily by the device. For example, a control code can be configured by a 
nvimber assigned to each respective kind of device's function and a serial 
30 number in each respective kind of device's function or can be configured by a 
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iinique control code used in the device, thereby facihtating the provision of 
each respective function in the device. 

In the case of a program, in which a display component includes a 
display element such as a still picture data and the like, an ID of the program 
can be used as the control code. 

Fig. 2 is a block diagram of the controller in the network control sys- 
tem of the present exemplary embodiment. By assigning the same reference 
nvmaerals to the same composing elements of Fig. 1 as used in Fig. 2, the de- 
scriptions of such composing elements are omitted. 

A controller signal processing means 10 receives a synchronous data 
from a synchronous data transmitting/receiving means 3 and performs signal 
processing as required by the controller. 

For example, in case where the controller is image display equip- 
ment such as a video monitor and the hke, a synchronous data (an MPEG 
stream, for example) is decoded and displayed on a display screen. 

A controller asynchronous data processing means 11 processes an 
asynchronous data received from an asynchronous data transmit- 
ting/receiving means 5 and transfers the processed data to an appropriate 
composing element in the controller. 

The controller asynchronous data processing means 11 sdso receives 
such information of a device on a transmission Une 1 as a connection of a new 
device, an elimination of an already-existing device and the like and device's 
function information 8 and the Uke from a packet transmitting/receiving 
means 2 via the asynchronous data transmitting/receiving means 5, and 
transfers the received information to a function information managing means 
12. 

Further, the controller asynchronous data processing means 11 
sends out an asynchronous data from composing elements in the controller to 
the asynchronous data transmitting/receiving means 5 according to a direc- 
tive from a display/equipment function selecting means 14. 
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Here, the asynchronous data transmitting/receiving means 5 and 
controller assnichronous data processing means 11 are allowed to be combined 
into an integrated one-piece means. 

When a controller and a device exist in the same equipment, the 
5 function performed by the device in the equipment is recognized by the con- 
troller and, since controlling in the equipment is performed directly by an 
equipment internals controlling means 9, the device's function is not regis- 
tered with a function data base 13 in the equipment although the eqmpment 
with the controller and device provided together has the function information 
10 8. 

Alternatively, the function information 8 may have the whereabouts 
thereof entered in the foregoing equipment configuration information 7 and 
also registered beforehand in the fimction data base 13. 
T" When a controller and a device exist in the same equipment, the 

15 controller signal processing means 10 and device signal processing means 4 
can be combined into an integrated one-piece means and also the controller 
asynchronous data processing means 11 and device asynchronous data proc- 
essing means 6 can be combined into an integrated one-piece means. 

The fimction information managing means 12 controls the function 
20 information 8 received firom a device on the transmission line 1 and, upon 
receiving information that a new device is hooked up fi:om the controller asyn- 
chronous data processing means 11, a directive that the new device's function 
information 8 should be entered is issued to the controller asynchronous data 
processing means 11. Upon entering the new device's function information 8, 
25 this function information 8 is registered with the function data base 13. 

Upon receiving information that an already-existing device on the 
transmission Une 1 is removed and the like, the function information manag- 
ing means 12 deletes the corresponding function information 8 fi:om the 
function data base 13. 
30 When the already-existing device is removed, an arrangement is 
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made in configuration to maintain the device's function information 8 in a 
storage means in a controller instead of deleting the device's function informa- 
tion 8 and, whenever the device is hooked up again, this device is recognized 
by the device's identification data and the like and the function information 8 
5 is retrieved fi:om the storage means in the controller and can be registered 
with the function data base 13, thereby enabhng the registration of connected 
eqviipment to be performed quickly. 

The function data base 13 is provided in a rewritable memory space 
and configured with the function information 8 received firom a device 

10 sei-ving as a data base. By browsing this data base with the use of the func- 
tion information managing means 12, it becomes possible to retrieve objects 
such as information on each respective device, information on each respective 
function and the like, ID's corresponding to the objects, a display component to 
inform the user of the objects, a display component to be displayed when the 

15 user operates the display component, a control code to be transmitted (an ob- 
ject ID assigned by the device, for example) and the like. 

Other than what is mentioned in the above, the function data base 
13 does not necessarily have to possess all the function information 8 at all 
times and it suffices that a needed portion only is to be possessed. 

20 The display/equipment function selecting means 14 informs the 

user of the display components (such as video/audio/character information 
and the Uke) indicating GUI information of a device and GUI information ^f a 
function and the like on a display screen of a controller and also issues a direc- 
tive to select a device and a function and to execute each respective function 

25 according to user's operation. 

Further, the display/eqmpment function selecting means 14 issues 
a directive to the function information managing means 12 to browse the 
function information 8, thereby displajdng on a screen a device on the trans- 
mission Une 1 and display components (name of device, name of function, stiU 

30 picture for display and the like) indicating the device's function. 
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When the user selects a display component indicating a function, this display 
component is replaced with the display component obtained from the function 
information 8 at the time of selection, and by displaying on the screen ac- 
cordingly the user knows that a selection has been made, thereby allowing 
5 the operation by the user to be facilitated. 

In addition, the display/equipment function selecting means 14 is- 
sues a control code and user's operation information corresponding to the dis- 
play component obtained from the function information 8 against the device 
via the controller asynchronous data processing means 11 and the Like. 
y5 10 Furthermore, the display/equipment frmction selecting means 14 receives the 
p\ control code, device's response to the user's operation information and status 

^ information of the instructed device via the controller synchronous data proc- 

^ essing means 11 and obtains a display component appropriate to the device's 

5^ Li 

I' status and the like from the function information 8 and displays on a screen 

15 accordingly, thereby so informing the user. 
C3 In this case, the controller does not necessarily xmderstand each 

p respective fimction of the device. For example, in case where the device may 

have a new function that can not be thought of at present, the controller takes 
out display components against the new function from the function informa- 
20 tion 8 and displays on a screen accordingly, thereby allowing the user to be so 
informed. Through these display components, the user vuiderstands the new 
function and, when this function is selected, the display/equipment function 
selecting means 14 of the controller obtains a control code corresponding to 
the new ftuiction with reference to the function information 8 and issues the 
25 control code and user's operation information against the device, thus en- 
abling the device to perform the new function. Accordingly, the configura- 
tion as described in the above enables the user to perform a new function that 
can not be thought of at present. 

Such composing elements as the synchronous data transmit- 
30 ting/receiving means 3, controller signal processing means 10 and the like can 
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be configured by making a selection arbitrarily according to the function of a 
controller or can be eliminated entirely. 

Fig. 3 shows a system configuration of a network control system in 
the present exemplary embodiment. 
5 In Fig. 3, a television receiver 21, a remote controller 22 for televi- 

sion receiver, a personal computer (PC) 23, a recordable/reproducible DVD 31, 
a DV system digital VCR (DVC) 32, a VHS system digital VCR (DVHS) 33, a 
DV system digital movie (DVC movie) 34 and a set top box (STB) 35 for CS 
digital broadcast and the like are typical examples of the equipment that 
10 deals with data on video, audio or information and are collectively called 
video/audio/information equipment in this specification. These pieces of 
video/audio/information equipment are hooked up to a transmission line 1, 
thereby structvuing an AVC system. The video/audio/information equip- 
ment includes not only the equipment as mentioned above but also all the 
15 equipment in respective areas of video, audio and information now in use 
(such as a printer, a minidisc player, a minidisc recorder and the hke, for ex- 
Cn ample) and also the equipment emerging in futvire. 

?1. Here, the television receiver 21 is equipment formed of a controller 

and a device (such as a terrestrial wave timer, video monitor and the like) and 

20 the user gives a directive to the display/equipment function selecting means 
14 by using a remote controller. The PC 23 is eqmpment formed of a con- 
troller and a device (a modem for interfacing to telephone line, video monitor 
and the Hke) and the user gives a directive to the display/ eqvdpment function 
selecting means 14 by using a keyboard, mouse and the like. 

25 The television receiver 21 and PC23 are defined as equipment, in 

which the device is integrated with the conti'oUer, and a function out of the 
functions of the device internal to the eqmpment is entered in the function 
information 8 when the function is accessible for use fi-om other equipment 
and not registered with the function data base 13 of the controller internal to 

30 the equipment although the function belongs to the equipment itself. 
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Further, the television receiver 21 and PC23 are defined as the equipment 
formed of a device and a controller, respectively, and in possession of the func- 
tion information 8 of each respective device internal to the equipment, and 
each respective piece of the function information 8 internal to the equipment 
5 can be registered with the function data base 13 of the controller internal to 
the equipment. 

The 31 and DVC movie 34 are, respectively, a device whereby AV 
data can be recorded/reproduced. The DVC 32 and DVHS33 are, respec- 
tively, equipment formed of a device whereby AV data can be re- 
10 corded/reproduced and a device havrag a digital broadcast tuner function. 

The STB35 is a device having a timer fimction to receive a CS digi- 
tal broadcast. 

In the foregoing, although the DVD31, DVC32, DVHS33, DVC 
III movie 34 and STB35 are referred to as a device, respectively, these devices 

15 can be called equipment including a controller and a device, respectively, 
when each respective device is provided with an enviroronent where other 

s i 

m devices can be operated by the help of a hquid crystal panel and the like even 

S; if the size of the device is small and capable of performing operations such as 

allowing the user to select the function of other devices and the like by using a 
20 touch panel, remote controller and the Kke. 

Furthermore, it is also possible for each respective equipment of 
above to have a processing function as a controller and also a remote control- 
ler for the eqviipment, thereby having a display and a voice only displayed on a 
monitor with analog wire connections and the Uke and allowing the user to 
25 perform operations by the use of the remote controller of the equipment while 
watching the monitor screen. Fig. 4 is a diagram to describe the function 
information 8 in the present exemplaiy embodiment. 

As shown in Fig. 4, the function information 8 is mainly formed of 
two layers of a device information layer 41 and a function information layer 42 
30 and further a device GUI layer 44 is attached to the device information layer 
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41 and a function GUI layer 43 is attached to the function information layer 
42. 

Each respective layer is formed of an object in a Ust form, and a data 
object (such as a text object, still picture object and the like) having no sub- 
object and a Hst together are generally referred to as an object. 

Each respective object has an identification data (ID) to identify an 
object from others, type information to indicate a type of object, attribute in- 
formation to describe such a configuration as having a sub-object and the like 
or not, size information to show a size of object, and the like in a header seg- 
ment. Each object indicates a sub-object by ID information in the entry as 
carried in the hst. 

In addition, when an object is smaU in data quantity like a text ob- 
ject and the like, the object itself can be entered in the entry segment in the 
hst. 

Also, the imique information of each respective hst is entered in the 
header and the like internal to each respective hst and the vuiique information 
of data object is entered in the entry segment. Additionally, the unique in- 
formation can be entered in any place selected form the object and the entry 
segment. 

The device information layer 41 is a hierarchy to shoAV device's in- 
formation, and in a device information hst in the device information layer 41 
are carried such own information as a kind of protocol and demand supported 
by the device, device type derived by coding the type of the device, version 
information of the device and the hke. 

The device type is allowed to be expressed by a code or a character 
string as shown in sub-unit type of AV/C Digital Interface Command Set 
(AV/C - CTS) discussed in 1394TA (1394 Trade Association), for example. In 
addition, the device layer 41 is allowed to have the function information 8*s 
own information and can also enter the support level and size of the function 
information 8, the maximimi transfer rate of the equipment that can be trans- 
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ferred by a single time asynchronous transfer, and the hke as the own infor- 
mation. 

Here, these pieces of information can be entered in a device infor- 
mation Hst or in a root hst prepared as a host Hst of the device information hst. 
5 At this time, before the controller reads all the function information 8, the 
controller is allowed to determine whether or not the* level is supportable, 
what size of memory space is needed, how big the transfer quantity for one 
time transfer should be and the like, for example, by just looking at the hier- 
archy, thereby enabling the elimination of a useless transfer. 
10 The device GUI layer 44 is a hierarchy to show user interface in- 

prj formation of a device, having located here such display components as a device 

^ name expressing the name of the device by a character string, a model name 

4S expressing a type number assigned to a product by the maker by a character 

I' string, and the like, each formulating a text object, respectively. 

f'i 15 Also, here provided is a display component such as a still pictvire 

£3 object and the hke to show devices such as icons and the like, serving as a still 

in . ■ 

^3 picture object. 

These text object, still picture object and the like have an entry in 
the device information hst, respectively. 
20 In addition to above, the device GUI layer 44 has here an audio ob- 

ject and such a data as music and the hke indicating the device is allowed to 
be located. — 

As shown in Fig. 7, by using a moving image hst, a pseudo moving 
image formed of a pliurahty of still pictvires is allowed to be used by replacing a 
25 still picture object, thereby enabhng the user to have a more jBriendly opera- 
tion picture. 

Additionally, the foregoing pseudo moving image can be used by 
replacing a still picture in the function GUI layer 43 and the like of Fig. 4. 

Each respective object has an entry in a device information hst in 
30 the foregoing but, relative to objects with the same pxirpose, such a configura- 
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tion as using a GUI list and having an entry in this GUI list is allowed to be 
adopted. 

Furthermore, a configuration, in which for each respective classifi- 
cation of the GUI (such as display, selection, in operation, in use, error and the 
5 Uke) a corresponding GUI hst is provided, can be employed, thereby allowing 
the user to use a display that is easy to imderstand. 

Next, the function information layer 42 is a hierarchy, whereby the 
function of a device is indicated, and formed of a function menu hst and a 
function hst. The function menu hst is linked to an entry in the device in- 
f 3 10 formation hst and provided with an entry of each respective function indicated 
by each function hst and an entry of each of the display components for the 

rU operation display pictvire and the hst's own indication. 

IJ 

f U Here, the display components for the operation display picture and 
the hst's own indication are located according to the GUI hst, and a flag is 

15 attached to each respective entry of the GUI hsts, the flag indicating the pur- 

Ly pose of the display component (such as for display, for identification and the 

Ifi like). A data of each respective display component is located under the GUI 

.5 list. 

In addition to above, an entry of each respective display component 
20 can be directly located in the function menu hst, thereby having a flag indi- 
cating the purpose entered in the entry of each respective display component. 
Further, the function menu hst has information needed in constructing^an 
equipment's operation display picture and also has such information as a pic- 
ture size and the hke, which is assimied by the function information 8, as its 
25 own information in a header and the hke. 

The function menu hst has a function hst for each respective func- 
tion that is supported by this device and also has its unique information on a 
function type derived by coding the type of function and a flag and the hke to 
indicate whether there are the possibilities of losing this function dynamically 
30 or not. 
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For example, a VCR has such functions as replay, record, stop, fast 
forward, rewind, still, triple speed replay and the like and a function hst is 
prepared for each respective function of the foregoing. 

In each respective function hst is entered such a function type as 
5 replay, record, tape operation and the like, for example. Even against the 
device with a new function that can not be thought of at present, the function 
information layer 42 has a function hst for the foregoing new function. 

The function GUI layer 43 is a hierarchy that indicates user inter- 
face information of each respective function and the function hst for each re- 
Q 10 spective function prepared in the function infoimation layer 42 by sorting is 
further sorted in the function GUI layer 43 according the conditions of the 
I il user's operation and the device, the function GUI layer 43 prepares a GUI hst 

for each sorting and the GUI hst has its vinique information such as a GUI 
y type obtained by coding the type ofGUI and the hke. There are such entries 

f 3 15 as a text object, a still picture object and the like in the GUI hst and in the 
entries are contained the flags indicating each respective text, kinds (formats) 
cn of still pictures and the size of the still picture, and the like and further each 

Q data object's own information such as placement information on the display 

screen expressed by relative positions against the display screen, the relative 
20 positions being assumed by the device. 

As the GUI types there are, for example, the "screen display^' used 
when a function is displayed on the display screen of a controller, the "selec- 
tion" used when the foregoing function is selected on the display screen of the 
controller, the "in operation" used when a device is performing the foregoing 
25 function, the "error" used when the device rejects the command from the con- 
troller relative to the foregoing function, and the like. 

Also, against a device with a new function that can not be thought of 
at present, the data on this new fxmction is transmitted to the controller by 
having a display component such as a still picture and the like indicating this 
30 new function located in the function GUI layer 43, thereby allowing the user 
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to receive the information on the new function. 

The device GUI layer 44 is made to have only one still picture object 
but is allowed to have a plurahty of display components sorted according to 
the user's operation and device's condition. 
5 At this time, the display components are separated from one ano- 

ther according to GUI types prepared by coding the sort (such as display, se- 
lection, in operation, in use, error and the like) of GUI. The function GUI 
layer 43 is made to use a GUI Ust and to have a text object and a stiU picture 
object but also allowed to use only one selected from the text object and still 
C3 10 pictxire object without using the GUI Ust. 

j£ Fvirther, when one function has only one display component, the 

: function Ust can be eliminated and the text object and still picture object can 
ry be located directly in the function menu Ust. 

I^J Fig. 5 is a diagram to describe a network control system in the first 

15 exemplary embodiment and a description is given to the control operation of a 
^ controUer and a device with reference to Fig. 5. 

tn In Fig. 5, when a device is hooked up to the transmission Une 1, a 

£3 

f 5 controller on the transmission line 1 recognizes the new device by means of a 

bus reset and the Uke in case of the 1394 bus, for example, reads the function 
20 information 8 from the new device via the transmission line 1 according to a 
directive of the function information managing means 12 and reads the func- 
tion information 8 for registration with the function data base 13 of the con- 
troller. 

Here, each respective piece of the function information 8 is sorted by 
25 each device*s xinique ID and the Uke, thereby estabUshing a Ust configuration 
having an entry for each respective device. 

At this time, all the function information 8 can be read together or 
only part of the function information 8 can be read . Further, the function 
information 8 can be read by each object or by each Ust. For example, a 
30 packet transmitted from a device to a controUer is transmitted with a display 
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component and the ID thereof combined as shown in Fig. 6(a). 

In case where a controller does not have enough memory areas, for 
example, the device information layer 41 and device GUI layer 44 can be first 
read when a new device is newly connected. Also, each respective display 
5 component is sorted in the controller with the use of an ID formed by com- 
bining the device's own xmique ID and the display component's ID assigned by 
the device. However, the controller can be configured to have a conversion 
table between (the unique ID of the device + the ID assigned by the device) 
and a new ID, which is formed by a renewal of the ID of each respective dis- 

10 play component carried out by the controller. In addition, a display compo- 
nent having an ID is included in the function information 8. 

The display/equipment fimction selecting means 14 sees for refer- 
ence the function information 8 (or part of the function information 8) in the 
function data base 13 via the function information managing means 12. 

15 When the display/equipment function selecting means 14 displays a 

Usting of the devices connected with the controller, the display/equipment 
function selecting means 14 reads the display components of the device GUI 
layer 44 (such as a text object, a still picture object and the like) fi:om the func- 
tion information 8 of all the devices registered with the function data base 13 

20 by using the function information managing means 12 and displays the dis- 
play components on the screen. It is not necessary to display all the display 
components of the device GUI layer 44 and only the display components-se- 
lected appropriately is allowed to be displayed on the screen. 

According to service conditions of each respective equipment, a stiQ 

25 pictiure object such as "in use" and the like is read from the device GUI layer 
44 and can be displayed on the screen, thereby allowing the user to use a more 
easily imderstandable device Hsting. 

When there is an audio object in the device GUI layer 44, this is not 
used at the time of displaying a Usting of devices and, when a new device is 

30 hooked up under the conditions where a device hsting has already been dis- 
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played, for instance, the still picture object of the new device is displayed on 
the screen and at the same time the audio object is reproduced. 

Next, when the user has selected the still picture object of a device, 
for example, by using the remote controller's pointing function (such as keys 
5 with a cross-like arrangement of a remote controller indicating up-and-down 
or side-to-side movements) and the like, the display/eqxupment function se- 
lecting means 14 reads display components of the function GUI layer 43 from 
the function information 8 of the device and a function Ust of each respective 
^5 function entered in the function menu hst of the function information layer 42 

10 by using the function information managing means 12, thereby displaying on 
y the screen a display component corresponding to each respective function. 

j| Accordingly, display components indicating aU the functions of this 

device are allowed to be displayed on the screen. Each respective display 
C3 component is identified according to the unique ID of the device and the ID of 

* Li 

f § 15 each respective display component here, too. 

^L; Although each respective function has a display component, due to 

C3 the relation with other display items and such restrictions as pictxire's resolu- 

tion and the hke, such flexible measures as displaying only the text objects 
without displa5dng the still picture objects against several functions and 
20 changing the positional relations between stiQ pictiire objects for each respec- 
tive function and the like can be taken even when enough locations can not be 
retained for displa5dng the display components for all the functions. — 

In other words, since each respective device has a display compo- 
nent for each respective function, the right to make a final determination of 
25 image display is allowed to rest with the controller, thereby enabling the re- 
ahzation of flexible displaying. 

Next, when the user selects, for example, a display component indi- 
cating device's reproducing function, the display/equipment function selecting 
means 14 transmits an ID of the display component assigned by the device as 
30 shown in Fig. 6 (b) with the ID serving as a control code to the device together 
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with user's operation information (such as "selection", for example). 

More specifically, the cursor is moved onto the display component 
by manipulating the remote controller's keys with a cross-like arrangement 
and, even when a selection button is released after the selection button is 
5 pushed down, the ID (control code) of the display component and the user's 
operation information ("selection") are transmitted to the device. When a 
text object for explanation, which describes the function of the GUI Hst of the 
function GUI layer 43 is located imder the GUI hst and in case where one of 
the buttons located on the remote controller except for the selection button, 
''ri 10 the explanation button, for example, is pushed by the user and then the ex- 
3^ planation button is released, the ID of the display component and the user*s 

operation information ("explanation") are sent to the device: 

Sending more detailed operation information of the user is also pos- 
sible. By performing such an operation as "push", "release", "push twice" or 
15 the like through a remote controller or a pointing device, sending these pieces 
of operation information to the device is also possible. 

Here, the user's operation information is coded and can be sent to- 
gether with a display component's ID or each respective piece thereof can be 
sent as a command (a control code such as a display component's ID and the 
20 like acting as an operand). 

Since a display component's ID is used as a control code in the pre- 
sent exemplary embodiment, it is not necessary for a specific control code such 
as a command and the like corresponding to a function to be seit forth by a 
standardization organization and the Like and all the functions, which a device 
25 has, can be controlled with the use of a simple configuration. 

When the user has selected a display component indicating the re- 
producing function of a device, for example, the display/equipment fimction 
selecting means 14 displays reproduced images fi-om the device on the screen 
upon receiving a correct response from the device and at the same time takes 
30 out a display component of "in operation" fi-om the reproducing function locat- 
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ed in the function GUI layer 43 and have this display component overwritten 
on the display component indicating the reproducing function. 

Although the display component is described as being changed in 
the foregoing when a correct response is sent back from the device, the display 
5 component to be displayed can be renewed when the device is brought into a 
reproducing status with a set up estabhshed in advance so as to keep watch- 
ing the conditions of the device. When the device's conditions have changed 
as observed in the device asynchronous data processing means 6 and equip- 
ment internals controlling means 9 of the device, a set up can be estabhshed 
10 so as to inform the controller, which has transmitted an originating control 
code, that the change in conditions has taken place. At this time, it is no 
y longer required of the controller to watch the device's conditions, thereby al- 

jf lowing the traffic of, the transmission line 1 to be reduced with a resulting 

effective use of the band of the transmission line 1, and also allowing the con- 
C3 15 troller's load to be reduced. 

12 When a control code transmitted from the controller is not accepted 

by the device for one reason or another, the display/equipment function se- 
£3 lecting means 14 detects that the device has not accepted the control code 

through the response to the transmitted control code , the observation of de- 
20 vice's conditions and the like, takes out a display component of "error" from 
the reproducing function located ia the function GUI layer 43 and has this 
display component overwritten on the display component indicating the--re- 
producing frinction and displayed on the screen. In the foregoing, the display 
component of "error" is described to have been overwritten on the position 
25 where the display component indicating a reproducing function is located but 
can be displayed by enlargement on the screen at such a conspicuous position 
as the center of the screen and the Hke, for example. 

In addition, as shown in Fig. 8, a host memory area, where a con- 
troller's identification data (unique ID) controlling this device is written, can 
30 be had as a host object with the device information hst linked thereto in the 
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device information layer 41 in the device. 

At this time, a controller intended for controlling a certain device 
first reads the host object and checks whether or not a vaUd ID is written in 
the object. If not, the controller writes its own device's ID in the host object. 

Additionally, also allowed is such an arrangement as the controller 
sends its own ID to the device and the device writes in the host object. 

In case where an ID of a different controller is written in the host 
object, the different controller is in use and therefore a display component 
indicating that the device is being used is displayed on the display screen in 
the controller. 

A controller finished with the use of a device makes the host object 
invaMd by clearing (entering zero, for example) the contents of the device's 
host object, and the hke. Accordingly, the controller can easily know wheth- 
er this device is in use or not by checking the object, thereby readily enabling 
the reahzation of an exclusive control of the device. 

At this time, a flag indicating whether or not a vahd ID is carried in 
the host object can be had in a host entry. Fvirther, when an object in the 
device has changed, a controller that should be informed of this change can be 
easily found just by checking the host object. When the device does not ac- 
cept a control from the controller because of recording being programmed and 
the like, the device can prevent interference caused by other controllers by 
recording the device's own ID in the object. The controller may be allowed to 
write priorities in the right to use in the object's entry and the hke together 
with the ID and it can allowed that a controller having a priority higher than 
the priority in the right to use as mentioned above can have the right to re- 
write the host object. 

In addition, it can also be allowed that the controller transmits pri- 
orities in the right to use to the device together with an ID and the device 
writes these in an entry and an object of the host object. 

A set up is estabhshed for the device so as to check in a predeter- 
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mined period after having received a control code whether or not the controller 
of the ID indicated by the host object exists on the transmission hne 1, thereby 
allowing the situation, where a controller no longer existing on the transmis- 
sion line stays on with the right to use kept retained, to be evaded. 
5 Instead of being checked, the controller can be cleared in a prede- 

termined period after having received the control code. In this case, the ID 
of a controller, the right to use of which is to be continued, has to be written 
again in the host object dxiring the foregoing predetermined period. 

Alternatively, in case where the conditions of the transmission line 
":S 10 1 have shown a change to have a device or a controller on the transmission 
ir; line 1 added/disappeared, the controller detects this change in conditions by 

IJ bus reset and the like, for example, and in a predetermined period after the 

Iji bus reset can write its own ID in the host object of the device, the right to use 

of which is desired to be continued. 

s 

E3 15 At this time, the device prohibits the controllers not having the 

□ right to use before the bus reset from writing in the host object during the 

s ! 3 

f ^ foregoing predetermined period after the bus reset. 

In addition, in case where no writing in the host object takes place 
in the predetermined period after the bus reset, the device makes the contents 
20 of the host object invahd and divests the right to use. 

In addition to above, a device that is controllable by two controllers 
is allowed to have two host objects. — - 

Although every display component for each respective device and 
function is transferred from a device, when display components different from 
25 one another are received from a pluraUty of DVC*s, for example, are received, 
a display component of each respective function existing in the function in- 
formation 8 of any DVC can be used for the common function of these DVC's 
and, relative to a function existing in a specific DVC only, the screen data of 
the DVC is allowed to be used. 
30 With regard to general functions, a controller has a display compo- 
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nent in advance and enters the information indicating these functions (such 
as a command determined by an organization for standardization and the Uke, 
for example) in the function information 8 in a device so as to estabhsh a set 
up not requiring the display component, thereby allowing the display compo- 
5 nent in the controller to be utihzed against these functions. 

Thus, by providing commonahty among a few devices in display 
components of function or device, consistency can be maintained among the 
images displayed by a controller, displays produced at the time of operations 
and the like. 

10 As needs dictate, one or a few of the device information layer 41, 

function information layer 42, function GUI layer 43 and device GUI layer 44 
can be omitted in consideration of equipment ability, function and the Kke. 

The function information 8 is also allowed to have a sub-device in- 
formation layer to show information of a sub-device and a sub-device GUI 

15 layer to show GUI information of a sub-device under the device information 
layer 41. In the foregoing, the configuration of the sub-device information 
layer is the same as that of the device information layer 41 and the configura- 
tion of the sub-device GUI layer is the same as that of the device GUI layer 44. 

According to the present exemplary embodiment, a device has a 

20 display component to configure the device's operation picture and a control 
code corresponding to the display component and a controller reads the dis- 
play component and control code from the device and displays the display 
component on the display screen. When the user manipulates the display 
component displaying on the display screen, the controller transmits the con- 

25 trol code corresponding to the display component and the user's operation 
information to the device, thereby allowing the device to reahze an operational 
environment that the user can understand easily in a simple configuration 
through the execution of the function indicated by the display component ac- 
cording to the control code and user's operation information and also to cope 

30 readily with a device having a new fimction that may not be thought of at 
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present. 

In addition, it can be readily realized that a button is provided with 
a plvirahty of functions according to the user's operation. 

Furthermore, the function executed by the device is allowed to vary 
5 in accordance with the user's operation of one of the display components, 
thereby making it possible to realize the operation of many functions with 
a small nvunber of displays. 

Additionally, by having a function table of all the devices that are 
usable by a controller, information of each respective device is allowed to be 
10 displayed quickly. 

Also, with a device information layer to indicate device's informa- 
tion to function information and a function information layer to indicate the 
function of the foregoing device provided in the function information, the op- 
erational environment for each respective device and the operational envi- 
15 ronment for each respective function of the device are allowed to be optimized, 
thereby enabling the reahzation of an operational environment that is friendly 
to the user. 

The provision of a device GUI layer and a function GUI layer, in 
which device's user interface information indicated by a device information 
20 layer and a function information layer is entered, allows a flexible operational 
environment to be created for each respective device or for each respective 
function. — 

Further, by having the function information provided with a display 
component indicating a device or a function, it becomes possible for a screen 
25 display to be optimized for each respective device and function, thereby al- 
lowing the user to have an operation picture that is easy to imderstand. 

In addition, with a device GUI layer or a function GUI layer provid- 
ed with its own display component for each respective sort, it becomes possible 
for a screen display to be optimized for each respective sort of each hierarchy, 
30 thereby allowing the user to enhance intuitive understanding and have an 
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operation picture that facilitates operation. 

Moreover, by making a control code as an object ID of a display 
component, the identification of the display component and the function indi- 
cated by the display component can be controlled with one code, thereby facili- 

5 tating the control of display components in a device and also ending up with a 
small nimiber of locations for memory and the like to reahze easy handling. 

Furthermore, the information in the function information is differ- 
entiated by using the ID of each respective object and, therefore, each respec- 
tive object can be located in an arbitrary space in a device irrespective of a 

10 physical element such as ROM, RAM and the like, and further only part of the 
function information such as a device information Hst and the like can also be 
configured in a directory configuration. 

When a display component is altered, a device transmits the infor- 
mation on the altered display component to a controller, thereby not requiring 

15 the controller to always watch an object that has the possibilities of undergo- 
ing alterations with a resulting reduction in processing by the controller and 
coping readily with the object that xmdergoes incessant alterations. 

When a device has a host object that carries an ID of a host at the 
present time and, when a controller controls the device, the controller writes 

20 its own ID in the host object and gains the right to use, thereby allowing 
the location, where a notice to be dehvered at the time when a display compo- 
nent in the device xmdergoes an alteration, to be foimd easily and also-en- 
abling the realization of an exclusive control with a simple configuration. 

When a controller controls a device, the controller writes its own ID 

25 in a host object acting as a host memory area and also writes a flag indicating 
priorities of the right to use, thereby enabling the grant of an approval to the 
controller by assigning priorities thereto as a resvdt of gaining the right to use. 

A device confirms whether or not a controller with an ID indicated 
by a host object in a predetermined period after the most recent time, when a 

30 command was accepted, exists on the network, thereby preventing the con- 
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troUer from suspending operation while the right to use being retained by the 
controller. 

A device makes the contents of a host object invalid in a predeter- 
mined period after the most recent time, when a command was accepted, and 
5 the device can prevent a controller, which desires to keep holding the right to 
use, from suspending operation while the right to use being retained by the 
controller by rewriting the controller's own ID in a host object of the device in 
a predetermined period after the most recent time, when a command was sent 
to the device. 

10 When the right to use of a device is continued, a controller rewrites 

a controller's own identification data in a host memory area of the device in a 
predetermined period after the change in conditions of the transmission Hne 
and the device can make the controller, which is using the device, continue , 
holding the right to use irrespective of the conditions of the transmission line 

15 and also the device prevents the controller from suspending operation while 
retaining the right to use by making the contents of the host memory area 
invalid. 

By having an audio object included in the function information, the 
optimimi audio information is made available to the user in accordance with 
20 the situations. 

Additionally, a flag indicating the method for reproducing the audio 
object can be provided here, thereby allowing finer expressions to be realized. 

Although a still picture data or a text data is to be used as a display 
component in the device GUI layer or the function GUI layer, an image screen 
25 and an audio output of a controller are allowed to be reahzed with the use of 
an execution code executable in the controller and a byte code assuming a 
virtual machine. In this case, there exist some restrictions in the configura- 
tion of the controller (such as kinds of CPU, a support to the virtual machine 
and the like) but the same effects can be gained and also 
30 a variety of expressions are made possible. 
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(Second Exemplary Embodiment) 
Next, a description is given to a second exemplary embodiment of 
the present invention with reference to drawings. 

Fig. 9 is a diagram to describe function information in a second ex- 
5 emplary embodiment of the present invention. A description of the sarae 
composing elements as used in the first exemplary embodiment is omitted 
here. 

In Fig. 9, a function information layer 42 in the function information 
8 has a function hst for each respective function supported by a device and 

10 unique information such as a function type formed by coding the type of a 
function, a flag indicating a possibility of whether the function vanishes or not 
dsmamically and the like is included in a header and the like. 

For example, a VCR has such functions as replay, record, stop, fast 
forward, rewind, still, triple speed replay and the like and a function Ust is 

15 prepared for each respective function of the foregoing. In each respective 
function hst is entered such a function type as replay, record, tape operation 
and the hke, for example. Even against the device with a new function that 
can not be thought of at present, the function information layer 42 has a func- 
tion hst for the foregoing new function. 

20 A function GUI layer 43 is a hierarchy that indicates user interface 

information of each respective function and the function Ust for each respec- 
tive function prepared in the function information layer 42 by sorting^ is 
further sorted in the function GUI layer 43 according to the user's operation 
and the conditions of the device, thereby preparing a GUI hst for each sorting, 

25 in which xmique information such as a GUI type obtained by coding the type 
of GUI and the like is provided in a header and the hke. 

Such entries as a text object, a still picture object and the like and 
also an entry to a reference object are included in the GUI hst. 

There is information to indicate kinds of the reference object in a 

30 reference entry. This information includes, for example, a "device control 
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code" indicating a device's own control code, which the reference object shovild 
transmit to a device, a "command" indicating a command which the reference 
object indicates the function to the device, a "command impUed" which is not a 
command itself but impHes the function to the controller, a "cursor shift" or a 
5 "separate menu" giving the controller a directive to display on the operation 
display picture, a "writing^' whereby a directive is given to the device to write 
the object, and further, ia case where the object is an object with variables 
(such display components as a sUder and the like or part thereof, for example), 
an "increment", a "decrement", an "addition of step value", a "subtraction of 
10 step value" and the like indicating addition and subtraction of variables. 

When the kind of a reference object is a "command", the command is 
written in the reference object with a format whereby a device can reaUze the 
U function just by transmitting the content of the object as is to the device. 

For example, when an AV protocol of the 1394 bus is employed, the content of 
15 an FCP packet as is is carried. 

Accordingly, the controller is allowed to know the function through 
the reference object and the function is allowed to be displayed on the display 
screen by using the display component in the controller without using the 
display component in the GUI hst. 
20 Further, when the kind of a reference object is a "command hint", 

the closest command to indicate the function is carried from the standardized 
commands (such as AVC-CTS, for example). — 

As a result, the controller is allowed to know the outlines of the 
function through the reference object and the function is allowed to be dis- 
25 played on the display screen of the controller by using the display component 
in the controller instead of using the display component in the GUI hst. 

When the information of the function information 8 carried in the 
device can not be displayed as is due to such restrictions as the size of the con- 
troller's display screen and the Like, the controller is also allowed to use the 
30 "command hint" as the information for determining the display position of the 
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display component in the GUI list. 

When the kind of a reference object is a "cvirsor shift" or a "separate 
menu display", an ID of the object, to which the shift takes place, and an ID of 
the object to be displayed (a function menu Ust) are carried in the reference 
5 object. 

Further, when the kind of a reference object is "writing to", an ID of 
the object to be written to the device is carried in the reference object. In this 
case, the object to be written to may be or may not be in the function informa- 
tion 8 . 

10 What is to be written to is carried in the header section of a function 

y3 Ust, GUI hst, reference object and the hke. The reference object of this kind 

py is used against a display component such as an input box taking characters, 

^ numerals and the like as an input, a display component such as a selection 

I y 

^ box whereby one data out of several data is selected, an object having vari- 

5 15 ables, and the hke, for example. 

r1 When the kind of a reference object is an "increment", a "decrement", 

y an "addition of step value" or a "subtraction of step value", these commands to 

p the device are carried in the reference object. 

Fig. 11 is an exemplified configuration, in which a shder is realized 
20 with the function information 8. According to the configuration indicated by 
a shder hst, a display component with variables such as a shder, a dial and 
the like can be easily realized. — ■ 

A GUI entry in the shder hst of Fig. 11 has a display component to 
adjust each respective variable by addition or subtraction and an entry to the 
25 reference object, and the adjustment of the variables for an increase or a de- 
crease is performed by the user's selection of the display component (by 
pushing and releasing buttons of a remote controller). 

In other words, when the user selects a stiU picture object hnked to 
the GUI hst, a reference object is selected fi-om the reference hsts hnked to the 
30 GUI hst according to the sequence of entries recorded in the hst and executed. 
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When not only the adjustment of the variables for an increase or a decrease 
but an operation of writing the variables in the device is needed, the variable 
are allowed to be renewed by using reference objects of "increment" and 
"writing", for example. 
5 Here, the controller recognizes the function of the reference object to 

have the variables altered because of the kind of the reference object being an 
"increment" and, when the "writing in" the device fails, the controller reads an 
object indicating a variable in the device and displays a display component 
indicating a correct value. 
□ 10 In this occasion, although these functions can also be realized ac- 

j5 cording to the method as described in the first exemplary embodiment, the 

I configuration in the present exemplary embodiment allows the controller to 

rU know the alterations in variables caused by the operation of the user and to 

configure a more responsive operation picture without waiting for the respon- 
15 se of the device. 

In this connection, the ID of an object indicating variables is also 
to be carried in reference objects and the same function can be reahzed by 
using the reference object of "writing in" together with these reference objects. 

When the kind of a reference object is a "device control code", the 
20 content of the reference object can be an ID of a display component in the 
same way as in the first exemplary embodiment or can be a control code as- 
signed by the device separately. For example, by making reference objects 
indicating the same control code correspond to a plurahty of display compo- 
nents, a plxirahty of defferent display components are allowed to point to the 
25 same operating status of the device. 

Fiuiihermore, when the kind of a reference object is a "controller 
control code", the content of the reference object is a control code to specify the 
operating status of the controller. For example, the controller is allowed to 
give a directive such as data format conversion processing and the hke, an 
30 on/off operation of displaying on the operation picture, and the like, and the 
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device is allowed to direct the operating status of the controller. 

When the kind of a reference object is a "device control code"j a 
"command" and the like for controlling the device, the data in these reference 
objects are sent to the device to carry out the controlling of the device. 
5 Fig. 10 is an example of function information in case where a plu- 

rality of reference objects are involved. There is an entry to a reference Ust 
together with entries such as a text object , a stiQ pictvire object and the like in 
a GUI Ust. 

In the reference Ust are included entries to a pluraUty of reference 
□ 10 objects and an ID carried by each respective entry indicates a corresponding 
'"•S reference object. The entry sequence of the reference objects in the reference 

I ^ Ust indicates the order whereby each respective reference object is executed, 

f U The content of the reference object is the same as the one in Fig. 9. 

[J Also, instead of using the reference Ust, the GUI Ust is aUowed to 

15 have a pluredity of reference object's entries, resulting in gaining the same 
LJ effect. 

in Next, a description is given to the operating status when the func- 

tion information 8 indicated in Fig. 9 is read by a controUer. 

When a controUer reads a display component in a function GUI 

20 layer 43 from a function Ust for each respective function as carried in the func- 
tion menu Ust of a function information layer 42 and displays a display com- 
ponent corresponding to each respective function on the display screen, a-dis- 
play/equipment function selecting means 14 recognizes an entry to the refer- 
ence object in a GUI Ust of the function. 

25 When the user selects a certain display component indicated by the 

GUI Ust by using a pointing function and the Uke of a remote controUer, the 
display/equipment function selecting means 14 recognizes the kind of the ref- 
erence object indicated by the GUI Ust and, according to the directive thereof, 
executes the content indicated by the reference object. 

30 For example, when the kind of a reference object is a "display of a 
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separate menu", an ID of the function menu list indicated by the reference 
object is obtained and the content of the function menu Ust indicated by the ID 
is displayed on the display screen. 

When the GUI Ust has a reference hst, directives from the reference 
object are executed in a sequence indicated in the reference hst. For exam- 
ple, when there are a "device control code" and a "cxirsor shift" in this sequence 
in the reference hst, the controller transmits first the "device control code" to 
the device and, upon receiving a correct response from the device, the control- 
ler shifts the cursor to the object indicated by the reference object of the "cur- 
sor shift". 

When the device does not return a correct response, a display com- 
ponent of "error" is displayed for this function and the cursor is not allowed to 
shift. 

However, the controller has the right to make a final decision on these display 
operations. 

Accordingly, by making a control code independent from a display 
component correspond to each respective display component, the same fimc- 
tion is indicated readily by a plurahty of display components. 

Also, a device has a display component and a plurahty of control 
codes against the display component and, by the device's execution of the 
function indicated by the display component according to the control code, a 
plurahty of functions such as a screen display, a device control and the like-are 
allowed to be executed against a controller with a single display component, 
thereby enabling the user to execute a comphcated operation in one operation 
and making available a user-fi:iendly operation picture. 

In addition, the device's function is specified with the user's opera- 
tion and the control code combined and, therefore, a small nimaber of displays 
allows a comphcated operation to be presented to the user in such a way as 
easy to imderstand and also the device makes available an operation picture 
that can display many functions even on a controller's smsdl sized display 
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screen. 

Further, by making a display component correspond to navigation 
information of the operation picture, a device is allowed to specify the switch- 
ing between menus, cursor shifts and the like at the device's side, thereby 
5 making it easier for the user to understand the design concept of an operation 
picture as intended by a designer in charge. 

With a code for directing controller's performance included in a con- 
trol code, a device is allowed to give directives to the controller about the op- 
eration thereof, thereby enabling the reahzation of navigation on the control- 
f-^ 10 ler as intended by the designer of the operation picture and allowing a user- 
'5 fidendly operation picture to be available. Fiurthermore, when the user is 

fU faced with a situation where the device shows difficulties in handling the 

f y processing, the situation can be dealt with in the controller, thus enabling the 

ri expansion of the device's function and also the placement of a common proc- 

15 essing module in the controller only with resulting effective utilization of re- 
Ly sources. 

f S (Third Exemplary Embodiment) 

hi Next, a description is given to a third exemplary embodiment of the 

present invention with reference to drawings. 

20 Fig. 12 is a diagram to describe function information in a third ex- 

emplary embodiment of the present invention. The same composing ele- 
ments as used in the first exemplary embodiment are assigned with the same 
reference numerals and a description thereof is omitted here. 

In Fig. 12, a device information layer 14 in function information 8 is 

25 a hierarchy to indicate device*s information and the device's own information 
such as kinds of protocol and command supported by the device, a device type 
formed by coding the type of the device, version information of the device and 
the like is carried in headers and the like of a device information hst in the 
device information layer 41. An entry to a device GUI layer 44 is being car- 

30 ried in the device information hst. 
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A device GUI layer 44 is a hierarchy to indicate device*s user inter- 
face information and herein included are display components such as a device 
name with the name of the device expressed in a character string, a model 
name with the type number of a maker's product expressed in a string of al- 
5 phanumeric characters, and the like, each of which forms a text object. 

Also, there is a Hst for selection put in place here. In the hst for 
selection are included a plurahty of still picture's entries indicating the entries 
to a plurahty of still picture objects expressing icons of the device. Any one of 
the plurality of stiU pictures indicates this device and what differs from one 

10 another is in composition, reahstic-looking in expression and the like. 

In addition, the device GUI layer 44 has an identification informa- 
tion memory area, i.e., a selection ID object, to store a flag for identifying a 
display component selected by the user and an ID of a still picture object se- 
lected by the user from the still pictxire objects ia the hst for selection is stored 

15 as a flag for identification. 

Next, a description is given to the performance of a controller. 
When a display/equipment function selecting means 14 displays a device 
shown in Fig. 12, the display/equipment function selecting means 14 reads 
display components of the device GUI layer 44 (such as a text object, a still 

20 picture object and the like) by using a fimction information managing means 
12 from the function information 8 of the device taken into a function data 
base 13 and displays these on a display screen. Here, the controller acting as 
an icon to indicate the device recognizes entries to a hst for selection and a 
selection ID object in a device information hst and, when an ID of the still 

25 pictvire object selected by the selection ID object is carried in the hst for selec- 
tion, the controller displays the stiQ picture object of the ID ia the hst for selec- 
tion on the controller's display screen. 

Also, when a selected ID is not carried in the selection ID object, the 
controller displays the first stiQ picture object of the hst for selection on the 

30 display screen. 
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When the user desires to alter the icon of the device, the controller 
reads and displays all the still pictvires carried in the Ust for selection of the 
device. When a still pictiire indicating the device is selected according to a 
directive of the user, the ID of the still picture is entered in the selection ID 
5 object. 

Accordingly, by having a Ust for selection and a selection ID object, 
the user is allowed to select an image (an icon), a nickname and the like of his 
liking for the device and, even when a plurahty of devices of the same kind are 
hooked up with a transmission hne 1, the user is allowed to identify the device 
p~ 10 easily. 

'-■3 Furthermore, it is no longer necessary for the user to search for fa- 

sirs: 

rij vorite images inputted from a camera and the like and process the images to 

an appropriate size and, therefore, the user is allowed to attach the favorite 
images and nicknames to the device easily. 

Ly 

3 15 Although a description has been made with the still pictiu-e as a 

[j device in the present exemplary embodiment, the same effect can be gained 

ti for text data such as a device name and the hke and pseudo moving images 

Cf because of the Ust for selection and the selection ID object put in place. 

Although the selection ID object is made to have existed in the de- 
20 vice GUI layer 44, it can be entered in the device information layer 41. 

Moreover, a flag is allowed to be put in place to see whether the 
selection ID object exists in the entry of this object or not, thereby allowing-the 
controller to determine quickly whether a user defining object exists or not. 

(Fourth Exemplary Embodiment) 
25 Next, a description is given to a fourth exemplary embodiment of 

the present invention with reference to drawings. 

Fig. 13 is a diagram to describe function information in a fourth 
exemplary embodiment of the present invention. The same composing ele- 
ments as used in the first exemplary embodiment are assigned with the same 
30 reference numerals and a description thereof is omitted here. 
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In Fig. 13, a device information layer 41 in function information 8 is 
a hierarchy to indicate device's information and the device's unique informa- 
tion such as kinds of protocol and command supported by the device, a device 
type formed by coding the type of the device, version information of the device 

5 and the like is carried in headers and the like of a device information list in 
the device infoimation layer 41. An entry to a device GUI layer 44 is being 
carried in the device information hst. 

The device GUI layer 44 is a hierarchy to indicate device's user in- 
terface information and herein included are display components such as a 

10 device name with the name of the device expressed in a character string, a 
model name with the type nimiber of a maker's product expressed in a string 
of alphanxmieric characters, and the like, each of which forms a text object. 

Also, the device GUI layer 44 has as a still picture object a display 
component such as a still picture object and the like indicating such a device 

15 as an icon and the like. 

These text object, stiU picture object and the like have entries in the 
device information hst. F\irther, the device GUI layer 44 has an identifica- 
tion information memory area to store a display component acting as identi- 
fying information for the user to identify the device, i.e., a user defining object. 

20 Next, a description is given to the performance of a controller. 

When a display/equipment function selecting means 14 displays a device 
shown in Fig. 13, the display/equipment function selecting means 14 reads 
display components (such as a text object, a stiU picture object and the like) of 
a device GUI layer 44 by using a function information managing means 12 

25 fi:om the function information 8 of the device taken into a function data base 
13 and displays these on a display screen. 

Here, the controller understands the existence of an entry to a user 
defining object in a device information Ust and recognizes an ID of the user 
defining object with an icon to indicate the device and also, when a still picture 

30 data is carried in an object indicated by the ID of the user defining object, the 
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controller displays this data (the still picture data) of the display component in 
the user defining object on the controller's display screen. 

When the still picture data is not carried in the user defining object, 
the controller displays a still picture object indicated by the still picture entry 
5 in the device information Ust on the display screen. 

When the user desires to alter the icon of the device, the controller 
displays as candidates for selection a plurahty of still pictiures retained in the 
controller, for example. When one of the still pictures indicating the device 
is selected according to a directive of the user, this still picture data is entered 
10 in the device by using the ID of the user defining object. 
y3 Accordingly, by having a user defining object and allowing a con- 

Sy troUer to enter a still picture data in a user defining object in a device accord- 

ing to a user's operation, the user is allowed to define an icon of the device as 

f y 

^ needs require and, even when a plurahty of devices of the same kind are 

15 hooked up with a transmission line 1, the user is allowed to identify a device 
?1 easily, 

^3 Although a description has been made with the still picture as a 

□ device in the present exemplary embodiment, the same effect can be gained 

for text data such as a device name and the like by having a user defining 
20 object, thus allowing a nickname to be readily attached to the device, for ex- 
ample. 

Also, a flag showing whether a user defining object exists or not-ean 
be entered in the entry of the object, thereby allowing the controller to deter- 
mine quickly whether the user defining object exists or not. 

25 As described in above, according to the present exemplary embodi- 

ment, the user is allowed to attach a favorite image, nickname or the like to a 
device by having such provisions as an identification information memory 
area to store identifying information for allowing the user to identify equip- 
ment, receiving data of display components for identifying the equipment se- 

30 lected by the user and storing the foregoing data in the identification informa- 
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tion memory area, thereby allowing each respective device to be readily recog- 
nized even when a plurahty of devices of the same kind are hooked up and 
also allowing an operation picture to be configured according to the user's lik- 
ing. 

5 (Fifth Exemplary Embodiment) 

Next, a description is given to a fifth exemplary embodiment of the 
present invention with reference to drawings. 

Fig. 14 is a diagram to describe function information in a fifth ex- 
emplary embodiment of the present invention. The same composing ele- 
10 ments as used in the first exemplary embodiment are assigned with the same 
-3 reference numerals and a description thereof is omitted here, 

f y In Fig. 14, a device information layer 41 in function information 8 is 

5|1 a hierarchy to indicate device's information and the device's own information 

s is? 

=1^ such as kinds of protocol and command supported by the device, a device type 

ire 

£ 15 formed by coding the type of the device, version information of the device and 
r J the like is carried in headers and the like of a device information Hst in the 

^ device information layer 41. 

£3 • The device information 41 has entries to a device GUI layer 44 and 

a function information layer 42 carried in the device information hst. Also, 

20 the device information layer 41 has an entry to a plurahty of operation picture 
data, i.e., a plurahty of function menu hsts as the entry to the function infor- 
mation layer 42. — 

The function information layer 42 has a plurahty of function menu 
hsts and each respective header section has attribute information and the like 

25 as its own information together with ID's indicating these hsts entered therein. 
Each respective function menu hst has a display component to demonstrate 
what the menu itself indicates as a GUI hst and also has an entry to a func- 
tion Hst. 

Next, a description is given to the performance of a controller. 
30 When a display/equipment function selecting means 14 displays a device 
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shown in Fig. 14, the display/equipment function selecting means 14 reads 
display components (such as a text object, a stiU picture object and the Hke) of 
a device GUI layer 44 by using a function information managing means 12 
from the function information 8 of the device taken into a function data base 
5 13 and displays these on a display screen. 

Here, the controller displays a still picture object indicated by a still 
picture entry in a device information Hst.with an icon to indicate the device. 

When the user selects an icon of the device, for example, by using a 
pointing function (keys of a cross-like arrangement, for example) of a remote 
10 controller, the display/equipment function selecting means 14 retrieves a 
function menu Ust of the function information layer 42 by using the function 
information managing means 12, i.e., the entry of the device information hst 
in the function information 8 of the device. 

The controller detects that a pluraUty of function menu Hsts are en- 
15 tered in the device information Hst, thereby retrieving a GUI Ust to indicate 
the Ust itself of each respective function menu Ust and performing a display 
thereof on an operation pictm^e configured newly by the controUer, using the 
display components of text data, still picture data and the like as carried in 
the GUI Ust. 

20 When the user selects any one of these display components on the 

operation picture by using a pointing function and the like of a remote con- 
troUer, the controUer displays an operational display corresponding to^he 
display component on the display screen based on a sviitable function menu 
Ust. Accordingly, even when there are a pluraUty of separate menus, the 

25 controUer is aUowed to display each respective operation picture easily. 

Although the controUer was to configure newly an operation picture 
in the present exemplary embodiment, the controUer is aUowed to display first 
an operation pictxu-e of the function menu Ust corresponding to the first entry 
out of a pliu-aUty of menu entries existing in the device information Ust and 

30 then to display operation screens corresponding to menu entries of the device 
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information list by switching the screens with the use of a remote controller 
(menu button) and the like in sequence. 

Fig. 15 is a diagram to describe an exemplary embodiment different 
from the present exemplary embodiment, in which the device information Hst 
5 has only one entry to the function hst and the function information layer 42 
has a function menu hst of a layered structure. 

When the user selects an icon of the device, the controller displays 
an operation pictiure radicated by the function menu hst entered in the device 
information hst. 

10 At this time, the controller displays a display component to indicate 

the hst itself in the sub-function menu hst that corresponds to the entry 
against the menu entry located in the function menu hst. When the user 
selects a display component indicating a function menu hst in the sub- 
function menu hst, the controller displays an operation picture of the function 

15 menu hst corresponding to the display component. 

Accordingly, a device has a plurahty of operation pictvure data, each 
having a representation method different from what others have, and a con- 
troller displays an operation picture on the display screen by switching from 
one operation picture to others according to user's operation, thereby allowing 

20 the operation pictiu-e to be easily switched according to the apphcation and 
circimistances on the part of the user. 

Also, a controller is allowed to make the user recognize readily-the 
operation picture, which a device has, by preparing a selection picture for se- 
lecting a plurahty of operation pictures from a plvirahty of operation pictvure 

25 data of the device, which is the object to be controlled, and displaying the se- 
lection picture on the display screen and also the device is no longer reqxiired 
to have a selection picture for selecting a plurahty of operation pictures, 
thereby allowing the device's memory areas to be reduced. 

30 Industrial Usability 
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A device has one or more display components to configure an opera- 
tion pictm-e and has control codes corresponding to the display components, 
and a controller reads a display component and a control code firom the device 
and displays the display component on a display screen and transmits to the 
5 device a control code corresponding to the display component and user's op- 
eration information when the user manipulates the display component on the 
display screen. The device to receive the foregoing transmission executes the 
function indicated by the display component according to the control code and 
user's operation information, thereby enabling the reaUzation of a user- 
10 friendly operating environment with a simple configuration and also the pro- 
y3 vision for coping easily with a new device having new functions that can not 

be thought of at present. Furthermore, the functions to be executed by the 
device are allowed to be altered according to the user's operation of a display 
component, thereby enabling the reahzation of operation against many fimc- 
15 tions with a minimal amoxmt of displaying. 

A device has at least one or more display components to configure 
an operation picture and a pluraHty of control codes corresponding to the dis- 
play components, and a controller reads a display component and a control 
code fi*om the device and displays the display component on a display screen, 
20 and transmits some of the control codes out of the plxirahty of control codes 
corresponding to the display components and to the device when the user ma- 
nipulates the display component on the display screen. The device executes 
a fimction indicated by a display component according to the control code, 
thereby allowing one display component to respond to a plurahty of control 
25 codes and enabling the combined execution of a plurahty of function against 
the one display component and the execution of a comphcated operation in one 
time operation performed by the user. 

A device has at least one or more display components to configure 
an operation screen and a plurahty of control codes corresponding to the dis- 
30 play components, and a controller reads a display component and a control 
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code from the device and displays the display component on a display screen, 
and transmits a few of the control codes out of the plnraUty of control codes 
corresponding to the display components and user's operation information to 
the foregoing device when the user operates the display component on the 
5 display screen. The device executes a function indicated by a display compo- 
nent according to the control code and user's operation information, thereby 
allowing one display component to respond to a plurahty of control codes and 
enabhng the combined execution of a plurahty of functions against the one 
display component and the execution of a comphcated operation in one time 
10 operation performed by the user. Since a device's function is specified by 
y3 combining a user's operation and a control code, a comphcated operation can 

fy be indicated to the user in an easy-to-understand manner with a minimal 

amount of displaying and also quite a few functions can be displayed even 
H=; with a controller having a display screen which is small in size. 

15 With a code giving a directive to a controller on its operation includ- 

ed in a control code, a device is allowed to give a directive to the controller on 
its operation, thereby enabhng the reahzation of navigation on the controller 
as intended by the designer of the operation picture and the reahzation of 
display with a user-friendly operation picture. Moreover, even with the 
20 processing that is difficidt for the device to handle, processing in the controller 
is made possible, thereby allowing the device's function to be expanded and 
also allowing a common module to be provided only to the controller with a 
resulting effective utihzation of resources. 

With a control code serving as an object ID of a display component, 
25 both the identification of the display component and the function indicated by 
the display component are allowed to be managed by using one code, thereby 
facilitating the management of display component in the device and also 
ending up with a small number of memory areas such as memory vuiits and 
the hke with resulting ease of handling. 
30 By having a display component formed of a program that includes 
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display elements, the representation at the time of displaying can be made full 
of varieties, thereby making a user-friendly display available. 

When a display component undergoes an alteration, a device 
transmits the information of the altered display component to a controller, 
5 thereby allowing the controller to reduce the amount of processing without 
requiring the controller to watch always an object that is hkely to undergo 
alterations and readily to cope with object that is imdergorng alterations 
ceaselessly. 

A device has an identification information memeory area to store 
□ 10 identifying information whereby the user identifies the device and the device 
receives a data of a display component for identifying the equipment desig- 
nated by the user and stores the data in the identification information me- 
meory area, thereby allowing the device to have an image, a nickname and 
the like of user's liking attached to the device, allowing each respective device 
15 to be recognized easily even when a plvtrahty of devices of the same kind are 
hooked up and also allowing an operation pictiire to be configured according to 
the user's tastes. 

A device has an identification information memory area to store a 
plurahty of display component kinds, whereby the user identifies the device, 
20 . and a flag for identifying a display component of user's selection, the device 
receives the flag of the display component selected by the user and stores the 
display component in the identification information memory area according to 
the flag, thereby allowing the device to have an image, a nickname and the 
like of user's liking selected, allowing each respective device to be recognized 
25 easily even when a plurahty of devices of the same kind are hooked up and 
also allowing an operation picture to be configured according to the user's 
tastes. Furthermore, it is no longer necessary for the user to search for fa- 
vorite images or to pick images from a camera and the hke and process the 
images to an appropriate size and, therefore, the user is allowed to attach the 
30 favorite image and nickname to the device easily. 
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Since a device has a plxirality of operation picture data, each having • 
a representation method different from what others have, a controller 
switches from one operation picture to others appropriately according to 
user's operation, thereby allowing the operation picture to be easily switched 

5 according to the apphcation and circumstances of the user. 

A controller prepares a selection picture for selecting a plurahty of 
operation pictures from a plurahty of operation picture data of a device to be 
controlled and displays the selection picture on the display screen, thereby 
allowing the user to recognize easily the operation picture, which the device 

10 has, and also it is no longer necessary for the device to have selection screen 
for selecting a plurahty of operation screens, thereby allowing the device's 
memory areas to be reduced. 

A device has a host memory area, in which a host's identification 
data at the present time is carried and a controller gains the right to use by 

15 writing the controller's own identification data in the host's memory area of 
the device when it comes to controlling the device, thereby allowing the loca- 
tion, where a notice to be dehvered at the time when a display component in 
the device imdergoes an alteration, to be foimd easUy and also enabling the 
reahzation of an exclusive control with a simple configuration. 

20 A controller writes the controller's own identification data in a host 

memory area and also writes a flag indicating priorities of the right to use 
when the controller controls a device, thus allowing the controller to be-as- 
signed with priorities by gaining the right to use. 

A device confirms whether a controller of an identification data in- 

25 dicated by a host memory area exists on the network or not in a predeter- 
mined period after the time when the device accepted a command most re- 
cently, thereby enabling the prevention of the controller from disappearing in 
operation while holding the right to use. 

A device invalidates the contents of a host memory area in a prede- 

30 termined period after the time when the device accepted a command most 
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recently and a controller rewrites the controller's own identification data in 
the host memory area in a predetermined period after the time when the con- 
troller sent a command to the device most recently, thereby enabling the pre- 
vention of the controller fi-om disappearing in operation while holding the 
5 right to use. 

When the right to use of a device is to be continued, a controller 
rewrites the controller's own identification data in a host memory area of the 
device in a predetermined period after the time of status change in the trans- 
mission line and, when there is no rewriting in the host memory area in a 
10 predetermined period after the time of status change in the transmission line, 
^ the device invahdates the contents of the host memory area, thereby enabling 

riJ the controller, while using the device, to continue holding the right to use re- 

f Q gardless of the status of the transmission line and also enabling the proven- 

tion of the controller firom disappearing in operation while holding the right to 
s 15 use. 
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